A Study on the Convergence of Gradient Method with Momentum for Sigma-Pi-Sigma Neural Networks

نویسندگان
چکیده

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Convergence of Online Gradient Method for Pi-sigma Neural Networks with Inner-penalty Terms

This paper investigates an online gradient method with innerpenalty for a novel feed forward network it is called pi-sigma network. This network utilizes product cells as the output units to indirectly incorporate the capabilities of higherorder networks while using a fewer number of weights and processing units. Penalty term methods have been widely used to improve the generalization performan...

متن کامل

Lp approximation of Sigma-Pi neural networks

A feedforward Sigma-Pi neural network with a single hidden layer of m neurons is given by mSigma(j=1) cjg (nPi(k=1) xk-thetak(j)/lambdak(j)) where cj, thetak(j), lambdak are elements of R. In this paper, we investigate the approximation of arbitrary functions f: Rn-->R by a Sigma-Pi neural network in the Lp norm. An Lp locally integrable function g(t) can approximate any given function, if and ...

متن کامل

Uniform Approximation Capabilities of Sum-of-Product and Sigma-Pi-Sigma Neural Networks

Investigated in this paper are the uniform approximation capabilities of sum-of-product (SOPNN) and sigma-pi-sigma (SPSNN) neural networks. It is proved that the set of functions that are generated by an SOPNN with its activation function in C(R) is dense in C(K) for any compact K ∈ R , if and only if the activation function is not a polynomial. It is also shown that if the activation function ...

متن کامل

Adaptive critic for sigma-pi networks

-This article presents an investigation which studied how training o f sigma-pi networks with the associative reward-penalty ( A R-p ) regime may be enhanced by using two networks in parallel. The technique uses what has been termed an unsupervised "'adaptive critic element" (ACE) to give critical advice to the supervised sigma-pi network. We utilise the conventions that the sigma-pi neuron mod...

متن کامل

A Modified Sigma-Pi-Sigma Neural Network with Adaptive Choice of Multinomials

Sigma-Pi-Sigma neural networks (SPSNNs) as a kind of high-order neural networks can provide more powerful mapping capability than the traditional feedforward neural networks (Sigma-Sigma neural networks). In the existing literature, in order to reduce the number of the Pi nodes in the Pi layer, a special multinomial Ps is used in SPSNNs. Each monomial in Ps is linear with respect to each partic...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Applied Mathematics and Physics

سال: 2018

ISSN: 2327-4352,2327-4379

DOI: 10.4236/jamp.2018.64075